Multi-task Learning by Leveraging the Semantic Information

نویسندگان

چکیده

One crucial objective of multi-task learning is to align distributions across tasks so that the information between them can be transferred and shared. However, existing approaches only focused on matching marginal feature distribution while ignoring semantic information, which may hinder performance. To address this issue, we propose leverage label in by exploring conditional relations among tasks. We first theoretically analyze generalization bound based notion Jensen-Shannon divergence, provides new insights into value learning. Our analysis also leads a concrete algorithm jointly matches controls divergence. confirm effectiveness proposed method, compare with several baselines some benchmarks then test algorithms under space shift conditions. Empirical results demonstrate method could outperform most achieve state-of-the-art performance, particularly showing benefits

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Semantic Segmentation via Multi-task, Multi-domain Learning

We present an approach that leverages multiple datasets possibly annotated using different classes to improve the semantic segmentation accuracy on each individual dataset. We propose a new selective loss function that can be integrated into deep networks to exploit training data coming from multiple datasets with possibly different tasks (e.g., different label-sets). We show how the gradient-r...

متن کامل

KASIMIR - Work process embedded task management leveraging the Semantic Desktop

The effectiveness of semantic applications can be increased significantly if the system does not urge the users to take care of explicit semantic annotation creation. Today, semantic annotation creation is a well known bottleneck in semantic applications for enterprises. On the other hand semantic technologies have already proven to facilitate, e.g., a more efficient information management espe...

متن کامل

Leveraging Domain-Independent Information in Semantic Parsing

Semantic parsing is a domain-dependent process by nature, as its output is defined over a set of domain symbols. Motivated by the observation that interpretation can be decomposed into domain-dependent and independent components, we suggest a novel interpretation model, which augments a domain dependent model with abstract information that can be shared by multiple domains. Our experiments show...

متن کامل

Medweb Task: Identify Multi-Symptoms from Tweets Based on Active Learning and Semantic Information

Recently, the web have an ever increasing number of medical or clinical related information. Among all the data sources, social media is the most valuable. Ntcir-13 Medweb (medical Natural Language Processing for Web documents) releases the task which identifying the patient symptoms from text. This task exploits pseudo twitter messages as a cross language corpus covering Japanese, English, and...

متن کامل

Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval

Methods of deep neural networks (DNNs) have recently demonstrated superior performance on a number of natural language processing tasks. However, in most previous work, the models are learned based on either unsupervised objectives, which does not directly optimize the desired task, or singletask supervised objectives, which often suffer from insufficient training data. We develop a multi-task ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2021

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v35i12.17323